Quadratic surface support vector machine with L1 norm regularization
نویسندگان
چکیده
<p style='text-indent:20px;'>We propose <inline-formula><tex-math id="M1">\begin{document}$ \ell_1 $\end{document}</tex-math></inline-formula> norm regularized quadratic surface support vector machine models for binary classification in supervised learning. We establish some desired theoretical properties, including the existence and uniqueness of optimal solution, reduction to standard SVMs over (almost) linearly separable data sets, detection true sparsity pattern quadratically sets if penalty parameter on id="M2">\begin{document}$ is large enough. also demonstrate their promising practical efficiency by conducting various numerical experiments both synthetic publicly available benchmark sets.</p>
منابع مشابه
Least Squares Optimization with L1-Norm Regularization
This project surveys and examines optimization approaches proposed for parameter estimation in Least Squares linear regression models with an L1 penalty on the regression coefficients. We first review linear regression and regularization, and both motivate and formalize this problem. We then give a detailed analysis of 8 of the varied approaches that have been proposed for optimizing this objec...
متن کاملEfficient L1/Lq Norm Regularization
Sparse learning has recently received increasing attention in many areas including machine learning, statistics, and applied mathematics. The mixed-norm regularization based on the l1/lq norm with q > 1 is attractive in many applications of regression and classification in that it facilitates group sparsity in the model. The resulting optimization problem is, however, challenging to solve due t...
متن کاملThe F∞-norm Support Vector Machine
In this paper we propose a new support vector machine (SVM), the F∞-norm SVM, to perform automatic factor selection in classification. The F∞-norm SVM methodology is motivated by the feature selection problem in cases where the input features are generated by factors, and the model is best interpreted in terms of significant factors. This type of problem arises naturally when a set of dummy var...
متن کاملAdaptive Regularization for Transductive Support Vector Machine
We discuss the framework of Transductive Support Vector Machine (TSVM) from the perspective of the regularization strength induced by the unlabeled data. In this framework, SVM and TSVM can be regarded as a learning machine without regularization and one with full regularization from the unlabeled data, respectively. Therefore, to supplement this framework of the regularization strength, it is ...
متن کاملAn Error Bound for L1-norm Support Vector Machine Coefficients in Ultra-high Dimension
Comparing with the standard L2-norm support vector machine (SVM), the L1-norm SVM enjoys the nice property of simultaneously preforming classification and feature selection. In this paper, we investigate the statistical performance of L1-norm SVM in ultra-high dimension, where the number of features p grows at an exponential rate of the sample size n. Different from existing theory for SVM whic...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Industrial and Management Optimization
سال: 2022
ISSN: ['1547-5816', '1553-166X']
DOI: https://doi.org/10.3934/jimo.2021046